ERROR DIFFUSION HALFTONING SYSTEM 

5 CROSS-REFERENCE TO RELATED APPLICATIONS 
Not applicable. 

BACKGROUND OF THE INVENTION 

The present invention relates to systems for displaying digital images and, 
1 0 more particularly, to systems employing error diffusion halftoning for displaying 
digital images. 

A digital image is typically represented as an array of picture elements or 
pixels at some point during its storage and processing. The pixels, in turn, are 
represented by a value that quantifies the intensity of one or more chromatic color 

1 5 components of the image at the spatial coordinates represented by the pixel. 
The intensity is typically expressed as a value on a scale of gray levels extending 
between the "gray" extremes of black and white. In the case of a color image, the 
image is typically decomposed into a plurality of color planes. Each color plane 
comprises a gray scale image representing the intensity of the pixels for one of 

20 the three (for example, red, green, and blue) or four (for example, cyan, magenta, 
yellow, and black) color components of the image. The color image is created by 
superimposing the color planes for the image. 

To provide visually appealing, realistic images, the intensity of a pixel is 
commonly expressed with a resolution of as many as eight or twelve bits. With 

25 eight bits the intensity can be resolved to 256 levels and with twelve bits the 

intensity can be resolved to 4096 levels. On the other hand, display mechanisms 
such as printers, typically cannot display a pixel at such fine levels of resolution. 
Most printers are limited to binary resolution, that is, the choice between 
depositing or not depositing a drop of ink at the pixel location. Some printers can 
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select among a limited number of dot sizes or light and dark inks of a component 
color, but the resolution is still typically much coarser than that afforded by the 
input value for the pixel. To simulate the color resolution of the image, printers 
are designed to trade spatial resolution for color resolution in a process known as 

5 halftoning. In response to the high resolution input values for pixels of a region of 
the image, the printer is controlled to deposit ink at some percentage of the pixels 
in the corresponding region of the printed image. If done correctly, the human 
visual system will interpret the spaced dots of ink as an area of gray or color 
approximating the gray or color of the corresponding region of the original image. 

10 One common halftoning method is "ordered dithering." The printer is 

instructed to deposit a drop of ink at a location on the print medium if the input 
value of the pixel at that location exceeds a threshold value. If the pixel's input 
value is less than the threshold, ink is not deposited at the location. In ordered 
dithering, a threshold matrix is conceptually overlaid on the output medium and 

1 5 differing thresholds included in the matrix are associated with the various pixel 
locations on the medium. While ordered dithering is computationally 
conservative, the probabilistic nature of the process produces unwanted artifacts 
under many conditions and, for some applications, it is desirable to apply a 
process than reduces the likelihood of these artifacts. 

20 Error diffusion halftoning is a halftone method intended to improve on the 

results produced by ordered dithering. For error diffusion halftoning the high 
resolution input intensity value for the pixel is also compared to a threshold value 
to determine if ink is to be deposited at a pixel location. However, the threshold, 
which is often set at approximately one-half the maximum value of the pixel, 

25 generally does not vary as a function of pixel location. To achieve the halftone 
effect, the difference between the input value of a pixel and its "as printed" value 
or error is distributed among its unprinted neighbors and when a neighbor is 
printed, the accumulated error is added to the input intensity to obtain augmented 
input that is compared to the intensity threshold. For example, FIG. 1 
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schematically illustrates the distribution of error to neighboring pixels 22, 24, 26, 
and 28 when printing the exemplary pixel 20. For simplicity in the example, it is 
assumed that the pixel 20 has no accumulated error (A=0) and the augmented 
input value (A) is equal to the input value of the intensity of the pixel (V=239). 
5 Since the augmented input intensity (A=239) exceeds the threshold (T=127), the 
printer is passed an instruction if the form of a binary value (B=1) to deposit ink at 
the pixel location. The difference between the augmented input value (A) and the 
"as printed" value of the pixel (BX255=1X255) is the total error (5 = -16) which is 
distributed among the unprinted neighbors of pixel 20. In the example, the error is 

1 0 distributed according to the error filter weights first proposed by Floyd and 

Steinberg, ADAPTIVE ALGORITHM FOR SPATIAL GREY SCALE, SID INT. SYM. 
DIGEST OF TECH. PAPERS, 1975, that is, 7/16 of the total error (-7) is 
distributed to the pixel 22 immediately to the left of the printed pixel 20. Lesser 
portions of the error are distributed to three other pixels, 3/16 to pixel 28, 5/16 to 

1 5 pixel 26, and 1/16 to pixel 24 of the row immediately following the row in which the 
printed pixel 20 is located. Other error diffusion algorithms distribute different 
portions of the total error to other sets of pixels in the neighborhood of the printed 
pixel. 

FIG. 2 schematically illustrates the accumulation of error for a pixel 40 and 
20 the effect of accumulated error on the threshold determination made when the 
pixel is printed. Images are typically printed in raster scan order and diffused 
error is accumulated for a pixel 40 as the neighboring pixels 42, 44, and 46 in the 
preceding row and the pixel 48 immediately to the left of the current pixel 40 are 
printed. In other known algorithms error is accumulated in a like fashion but in 
25 differing proportions and from different pixels in the neighborhood. When it is 
time to print the current pixel 40, the input value (V=230) is augmented by the 
accumulated error (A= 25) to obtain the augmented input value (A=V+A = 230 + 
25 = 255) which is compared to the threshold value (T=127). Since the 
augmented input intensity exceeds the threshold, ink will be deposited at the 
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current pixel 40 but since the augmented value (A) equals the "as printed" value 
(BX255=1X255) there is no error (5=0) to distribute to neighboring pixels. 
Since the "as printed" value of the binary pixel is either the minimum or maximum 
value of the pixel, substantial positive and negative error can accumulate. The 
5 accumulated error may be sufficient cause a pixel to be printed or not printed 
even though its input intensity value would justify the opposite result. 

The magnitude of the threshold for error diffusion halftoning is generally 
independent of location and error diffusion is generally more accurate than the 
ordered dithering method. However, like ordered dithering, error diffusion is a 

10 quantization process and can produce artifacts in certain areas of an image. 
Error diffusion halftoning can produce "worms" or patterns of visible lines of dots, 
particularly in highlight areas. In addition, the diffusion of error to neighboring 
pixels can delay highlights by producing heavier patterns of dots in the later pixels 
of a halftone region. In midtone areas, error diffusion can produce a checker 

1 5 board effect that can visually interfere with a smooth transition between regions of 
the image. Error diffusion can also cause dots of differing colors to be deposited 
at the same pixel location. A magenta dot on a cyan dot produces a nearly black 
dot which can give the image a grainy look. 

To reduce the artifacts produced by the four pixel diffusion of the Floyd and 

20 Steinberg algorithm, error filters with additional weights have been proposed to 
further diffuse the error. Filters with additional weights require more computation 
and can accentuate certain artifacts while reducing others. In addition, error 
diffusion combined with perturbation ordithering has been proposed. However, 
these methods are computationally expensive and often add the artifacts of 

25 dithering to the artifacts produced by error diffusion. A third method of artifact 
reduction is to perform a spatial examination with the original input pixel values 
and use the results of the examination to alter an error diffusion halftone threshold 
to make it easier or harder to deposit ink at the pixel. This method is very 
computationally intensive because of the need to perform the examination in 
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addition to the halftoning process. 

What is desired, therefore, is an improved halftoning method that reduces 
artifacts produced by the error diffusion halftone method and conserves 
computational resources. 

5 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a schematic illustration of a diffusion of error in an error diffusion 
halftone method. 

FIG. 2 is a schematic illustration of the effect of diffused error on a pixel of 
10 a halftoned image. 

FIG. 3 is a block diagram of an exemplary computer system. 
FIG. 4 is a flow diagram of the halftoning method of the present invention. 
FIG. 5 is a block diagram of a halftoning encoder useful in applying the 
halftoning method of the present invention. 

15 

DETAILED DESCRIPTION OF THE INVENTION 

FIG. 3 depicts a typical personal computer system 50 including a personal 
computer 52 that transmits instructions to a display device, such as the ink jet 
printer 54. The instructions typically specify which of the individual pixels of an 
20 image are to receive a dot of ink and the color of the ink comprising the dot. The 
printer 54 receives these signals over an appropriate communication channel 56. 

There are many configurations for computer systems utilizing printers that 
can apply the method of the present invention. In the exemplary computer 
system 50 a central processing unit (CPU) 58 transfers data to printer 54 over an 
25 internal bus 60 that is connected to the communication channel 56 by an input- 
output adapter 62. The CPU 58 fetches data and instructions from a variety of 
sources, including read-only memory (ROM) 64 and read-write, random access 
memory (RAM) 66. The personal computer system 50 also includes a key 
board 68 connected to the internal bus 60 of the computer 52 by an interface 
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adapter 72. The keyboard 68 provides a mechanism for user input of data and 
instructions to the computer 52. The computer 52 also includes a display 70, 
such as a cathode ray tube or liquid crystal display monitor, connected to the 
internal bus 60 by a display adapter 74. The present invention is typically 
5 implemented as part of a printer driver, one of several components of the personal 
computer's operating system software that are stored on the disc drive 76 of the 
computer 52. 

The computer 52 typically reads and operates on the instructions of the 
printer driver in response to a print command entered by a user from a user 

10 interface of an application program. The application program responds to the 
command with a system call requesting that the image be printed. The printer 
driver responds with a sequence of operations necessary to convert a 
representation of the image into the low-level printer instructions that will cause 
the printer 54 to appropriately place dots of ink on the print medium rendering the 

1 5 image as faithfully as the printer's limitations will allow. 

For simplicity of description, it is assumed that the printer 54 is an ink jet 
printer capable of binary (ink or no ink) output of four color components (cyan, 
magenta, yellow, and black) at each pixel position. However, the method of the 
present invention is equally applicable to other types of printers and display 

20 devices, such as color laser printers and monitors, where the resolution of the 
displayed image is less than that of the original. For example, the method can be 
applied to printers that are capable of modulating the dot size or applying more 
than one shade of ink for a color component. 

The image is typically decomposed into a plurality of color planes. A color 

25 plane is a gray scale image representing the intensity of a color component at 
each pixel location in the image. The color image is constructed by 
superimposing a color plane for each of the three or more color components of 
the image. The input intensity values of the pixels are commonly represented by 
eight bit or twelve bit numbers providing a relatively fine resolution of the pixel's 
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intensity (256 levels or 4096 levels, respectively). The printer driver applies a 
halftoning operation to simulate the effect of the fine resolution input values of the 
pixels in a displayed image produced with the coarser resolution, typically binary 
resolution, permitted by the printer or other display device. 
5 Halftoning is a quantization process in which a fine resolution input 

intensity value for a pixel is converted to a coarser resolution output value by 
comparing the input intensity of the pixel to a threshold intensity value. If the 
threshold is exceeded, the binary resolution printer 54 is directed to deposit ink at 
the pixel location, but if the input value is less than the threshold no ink is 
10 deposited. In error diffusion halftoning, the difference between the input intensity 
of a pixel, augmented with the error accumulated from previous pixels, and its "as 
printed" intensity value (in the case of binary output, either "0" or the maximum 
value of the pixel) is distributed to unprinted neighbors of the pixel. When one of 
these neighbors is printed, the accumulated error will be used to augment the 
1 5 input value of the pixel. Since the error can be positive or negative, augmenting 
the input intensity of a pixel with the accumulated error increases or decreases 
the likelihood that ink will be deposited for the pixel. While error diffusion 
halftoning provides generally good results, the printed output may include 
halftoning artifacts. For example, highlight areas may contain patterned lines of 
20 dots or "worms." On the other hand, error diffusion can produce a checker board 
effect that visually interferes with the smooth transition between regions of the 
image and the distribution of error to later printed pixels can cause dark in regions 
in the image. Further, dots of differing colored ink can be deposited at the same 
location. A magenta dot and cyan dot at the same location produces a nearly 
25 black dot which can give the image a grainy look. Yellow ink typically does not 
create the problem and the black ink of a four-color component printer is generally 
controlled by a different mechanism. 

The halftoning artifacts are the result of uneven distribution of dots of the 
colored ink in halftoned areas of the image. While prior efforts to improve the 
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uniformity of dot distribution have examined the area surrounding a pixel in the 
original image to determine how ink dots should be distributed in the displayed 
image, these methods are computationally intensive. The present inventor 
concluded that halftone artifacts can be reduced with less computation by revising 

5 the halftone threshold to make depositing ink at a pixel more or less likely on the 
basis of the error accumulated for its neighbors. 

FIG. 4 depicts the error diffusion halftoning method of the present 
invention. The intensity of a gray scale color plane of an image or a gray scale 
image at spatial coordinates corresponding to a pixel to be printed (the "current" 

1 0 pixel) is converted to a discrete value and input to the method 120. If the pixel is 
white or black 122 the halftoning method is bypassed, an appropriate signal is 
sent to the printer by another process, and the next pixel is selected. If the 
current pixel is not black or white, the pixel's intensity is input 92 to the halftone 
encoder 90 depicted schematically in FIG. 5. 

15 In a summer 92, the accumulated error for the current pixel (e 0 0 ) 124 is 

added 126 to the input intensity (l P ) to obtain an augmented intensity (l A ). The 
current pixel error (e 0 0 ) is obtained from an error buffer 96 in which error 
produced by printing prior pixels is accumulated for a number of pixels. For 
convenience, the error of the currently printing pixel is contained in the location 

20 designated by the index position "0" of row "0" (e 0 0 ). The exemplary encoder 90 
utilizes the error filter 98 with filter weights first proposed by Floyd and Steinberg, 
ADAPTIVE ALGORITHM FOR SPATIAL GREY SCALE, Sid. Int. Sym. Digest of 
Tech. Papers, 1975. As illustrated, this error filter distributes the error produced 
by printing the current pixel 100 to the unprinted pixel immediately to the right of 

25 the current pixel and three neighboring pixels of the next row of pixels. The 

exemplary error buffer 96 includes the accumulated error (e 0 0 ) 104 for the current 
pixel 100 and a number of other pixels (designated by an index position relative to 
the index position for the current pixel) of the current pixel row (row 0) 106 and the 
next row (row 1) 108. Other error diffusion algorithms may diffuse the error over 
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more remote pixels of the current pixel row or pixels of more remote rows and 
require an error buffer appropriate to store the accumulated error for the affected 
pixels. The error for each color plane may be stored in separate error buffers 96 
or may be stored in a single buffer as interlaced data. Further, since threshold 

5 selection is determined by the sign of the accumulated error, the error buffer size 
can be reduced by storing only a sign bit for previously printed pixels. 

In the encoder 90, the augmented intensity (l A ) of the current pixel is 
compared to one or more thresholds in a thresholding unit 110. To improve the 
sharpness of edges and fine details in the displayed image, the augmented 

10 intensity may be compared to an initial threshold (threshold 0) 128 in an initial 
threshold unit 109. The present invention improves the evenness of ink 
distribution to reduce the likelihood that halftone artifacts will develop. However, 
a more even distribution of ink reduces the sharpness of edges and details in the 
printed image. The initial threshold is relatively high (for example, T 0 =224) 

1 5 compared to the other halftoning thresholds used in the method, but depositing 
ink at pixels having high augmented intensity increases the sharpness of the 
displayed image in appropriate areas and reduces the processing time. If the 
augmented intensity of the current pixel (l A ) exceeds the initial intensity threshold, 
the method outputs the binary signal (B=1) 130 to direct the printer to display or 

20 deposit ink at the pixel 1 32 and the pixel is assigned the maximum displayed 
intensity or "as printed" intensity value (for example, BX255) 155 for error 
diffusion 156. 

If the augmented intensity of the current pixel does not exceed the initial 
threshold 128, the augmented intensity will be compared to a threshold selected 
25 by the threshold selection unit 112. In the threshold selection unit 1 12, the 
accumulated errors for the current pixel and its neighbors are used to select an 
appropriate threshold intensity for comparison. The present inventor observed 
that halftoning artifacts can be reduced by improving the evenness of the ink dot 
distribution and that the accumulated error is an indication of the density of the ink 



-9- 



dots in the vicinity of the currently printing pixel . Referring to FIG. 1 , when a 
pixel 20 is printed, the pixel is assigned an "as printed" intensity value equal to the 
product of the maximum intensity for a displayed pixel and the binary output to the 
printer. When ink is deposited, the "as printed" intensity value of the pixel is 

5 maximized and negative error (6) is distributed to the pixel's neighbors. Negative 
error, therefore, indicates the presence of an ink dot in the vicinity of the current 
pixel. The inventor concluded the error for pixels of the neighborhood could be 
used to select an appropriate halftoning threshold to evenly space the dots of ink. 
In the threshold selection unit 112, the accumulated error for the current 

1 0 pixel (e 0 0 ) 1 34 and for the current pixel's immediate neighbors in the current row 
((e 0 _.,) and (e 0 .,)) 136 are compared to an error threshold to determine if one of 
the errors is negative. If the error of one of the pixels is less than zero, a first 
threshold (T a ) is selected 138 and input to the thresholding unit 110. If the 
accumulated error for each of the current pixel and the immediately neighboring 

1 5 pixels are positive, the errors for the next more remote pair of pixels ((e 0 _ 2 ) and 
(e 0 2 )) are examined 140. If the accumulated error of either of these pixels is 
negative, the threshold (T b ) 142 is input to the thresholding unit 110. If the errors 
accumulated for each of the current pixel and its nearer neighbors is positive, the 
errors ((e 0 _ 3 ) and (e 0 3 )) accumulated for a further remote pair of neighboring 

20 pixels are compared to an error threshold. If the error for either of these pixels is 
negative, the third threshold (T c ) is selected 146 and input to the thresholding 
unit 110. If the errors for each of the current pixel and its six neighbors are 
positive, a default threshold (T d ) 148 is input to the thresholding unit 110. The 
thresholds (T a ) 138, (T b ) 142, (T c ) 146, and (T d ) 148 have successively smaller 

25 values and are selected by experimentation. For example, in the prior art error 
diffusion methods the threshold value for eight bit resolution pixel intensity is 
typically approximately 127 (255/2). To more evenly distribute ink in a halftone 
region of an image and reduce halftone artifacts, the plurality of thresholds 
Ta=200, Tb=180, Tc=160 and Td=120 has been found to produce good results. 
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Negative error accumulated for the current pixel or its nearest neighbors indicates 
the presence of an ink dot in the vicinity and the higher threshold value reduces 
the likelihood that the current pixel will receive ink, pushing apart the ink dots in 
the printed image. Negative error for more remote neighbors indicates a 
5 likelihood of an ink dot in the vicinity but since the dot is more remote from the 
current pixel the visual impact is reduced. The lower threshold values adjust for 
the reduced visual impact of the more remote ink dots. A default threshold (T d ) 
148 having a value slightly less than the traditional error diffusion threshold has 
been found to be useful in balancing the dot spreading produced by the present 
10 method. 

To reduce the likelihood of depositing a cyan dot and a magenta dot at the 
same location, negative error in one color plane can be considered when printing 
pixels in the other color plane. If the error is stored as an interlaced value in the 
error buffer 96, a negative error for either component color is considered negative 

1 5 error for the other component when selecting the halftone threshold. 

In the thresholding unit 110, the augmented intensity of the current pixel 
(l A ) is compared to the selected threshold 150 in the selected threshold unit 111. 
If the augmented intensity exceeds the selected threshold, a pixel display 
signal 130 (a binary "1" for the exemplary, binary printer) is output by the 

20 encoder 1 14 and the pixel is displayed 132. If the augmented intensity does not 
exceed the selected threshold 150, a pixel "not displayed" signal 154 (binary "0") 
is output by the encoder 1 14. 

The pixel display signal is also input to summer 1 16 where the total error 
produced by the current pixel is determined by multiplying the binary printer signal 

25 value by the maximum value of a pixel to obtain an "displayed" pixel intensity 
which is subtracted from the augmented input intensity for the current 155. The 
total error is input to the error filter 98 and diffused to the neighboring pixels 156 
as apportioned by the filter weights. If the current pixel is the not last pixel of the 
image 158, the next pixel is input to the process 120. If the current pixel is the 
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last pixel 158, the halftoning process ends 160. 

The halftoning method of the present invention reduces halftoning artifacts 
while preserving the sharpness of edges and image details by controlling 
distribution of the ink dots making up the halftoned image. The method 
5 computationally conservative and fast because it utilizes the accumulated error for 
pixels neighboring the printing pixel to select a threshold and control ink dot 
distribution. 

The detailed description, above, sets forth numerous specific details to 
provide a thorough understanding of the present invention. However, those 

10 skilled in the art will appreciate that the present invention may be practiced 
without these specific details. In other instances, well known methods, 
procedures, components, and circuitry have not been described in detail to avoid 
obscuring the present invention. 

All the references cited herein are incorporated by reference. 

1 5 The terms and expressions that have been employed in the foregoing 

specification are used as terms of description and not of limitation, and there is no 
intention, in the use of such terms and expressions, of excluding equivalents of 
the features shown and described or portions thereof, it being recognized that the 
scope of the invention is defined and limited only by the claims that follow. 
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